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Abstract 

We study an algebraic deformation problem which captures the 
data of the general deformation problem for a quantum vertex alge- 
bra. We derive a system of coupled equations which is the counterpart 
of the Maurer-Cartan equation on the usual Hochschild complex of an 
associative algebra. We show that this system of equations results 
from an action principle. This might be the starting point for a per- 
turbative treatment of the deformation problem of quantum vertex 
algebras. Our action generalizes the action of the Kodaira-Spencer 
theory of gravity and might therefore also be of relevance for applica- 
tions in string theory. 
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1 Introduction 



In |Borj Borcherds has developed an abstract notion of vertex algebra as a 
certain singular commutative ring in a symmetric tensor category. He intro- 
duces a quantum vertex algebra as a singular braided commutative ring in 
a symmetric tensor category. He also remarks that, in addition, one could 
allow for the tensor category to be no longer symmetric but also braided. 
This is supposed to be of relevance for vertex operators with non-integer 
exponents in the formal series and should therefore be important for string 
theory with background fields (see |KUj ). We will even drop the requirement 
of braidings and allow the inner ring, as well, as the tensor product of the 
outer category to become arbitrarily noncommutative. A generalization of 
vertex algebras where the inner ring has no longer to be braided has been 
developed under the name of field algebras in |BK]. We will drop most of 
the structure of a quantum vertex algebra and just consider the essential in- 
gredients of the deformation problem, i.e we keep just those structures which 
can be deformed. In consequence, we consider a C-linear, additive, monoidal 
category (C, •, ®) with composition • and tensor product ® together with an 
inner associative ring R. Finally, we make two additional generalizations: 

• In addition to and the product on R, we also allow the composition 
• of C to become deformed. 

• We pass from an inner associative ring R to an inner bialgebra object 
B in C with an associative product and a coassociative coproduct. In 
|BDj chiral algebras are introduced as a coordinate independent gen- 
eralization of vertex algebras. In the axiomatization used there, chiral 
algebras appear as a generalization of universal envelopes of Lie alge- 
bras in a certain monoidal category. One could consider in this case 
deformations of the outer category or of the inner algebra where - in 
the spirit of the theory of quantum groups - one could think of pass- 
ing from the deformation theory of Lie algebras to the more general 
deformation theory of Hopf algebras. By passing from to i? as the 
inner object, we want to include the essential data of the deformation 
problem of this case, too. 

We can therefore think of the deformation problem to be studied, here, 
as the most general deformation problem for the data of a quantum vertex 
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algebra (we will keep speaking of a quantum vertex algebra even in the most 
general case where an inner bialgebra object is allowed and ® is noncommu- 
tative). We will state a conjecture below that even generalizations of this 
deformation problem to higher category theory should not be possible. As 
an additional requirement on the structure of C, we will assume that there 
exists a forgetful functor to the category of vector spaces over C (where we 
allow vector spaces to become infinite dimensional). 

For an associative algebra A over C, the deformations of the product m 
to a new associative product are given by the solutions of the Maurer-Cartan 
equation on the Hochschild complex. More precisely, let « be a bilinear map 
on A and m + a the deformed associative product. The Hochschild complex 
of A consists of all hnear maps 

$ : A®" ^ A 

Call n the degree of $. On the Hochschild complex there is a product o given 
for $1 of degree and $2 of degree n2 by 

$1 o $2 (ai, ...,a„i+„2-i) 

m— 1 

— ( — 1) ^^^^ (afc+i, Ofc+na) , ak+n2+l, O-m+riz-l) 

k=0 

i.e. $1 o $2 is of degree ni + ^2 — 1. The Gerstenhaber bracket [, ] on the 
Hochschild complex is the graded commutator of o, i.e. 

$2] = $1 o $2 - (-l)("i-i)("^-i) $1 o $2 

Observe that [, ] lowers the degree by one, i.e. it is what is commonly called 
an antibracket. We can now rewrite associativity of m as 

[m, m] — 

because 

[m,m] (01,02,03) = 2 (m o m) (oi, 02, 03) 

~ m (m (oi, 02) , 03) — m (oi, m (02, 03)) 

Now, the requirement that m + a should be associative, again, can be stated 
as 

= [m + a,m + a] 

— [m, m] + 2 [m, a] + [a, a] 
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Using that [m,m] = 0, this gives 



[m, ct] + 2 t*^' '^1=0 

Defining 

dm^= [m, $] 

one checks that dm defines a differential on the Hochschild complex, i.e. 
{dfn)'^ = 0. The cohomology with respect to d^ is the Hochschild cohomology 
of A. 

So, the requirement that a gives a deformation of m which preserves 
associativity can be stated as 

which is the Maurer-Cartan equation on the Hochschild complex of A. We 
will show below that in the general deformation problem for a quantum vertex 
algebra, the Maurer-Cartan equation is generalized to a coupled system of 
differential equations. 

The Maurer-Cartan equation is the starting point for a perturbative so- 
lution of the deformation problem. Let 

oo 

a = ^ra„ (1) 

n=l 

where the a„ are bilinear operators on A, again, and t is the deformation 
parameter, i.e. in the perturbative treatment we consider a as a formal 
power series in t and the deformation of {A, m) as a deformation over C [[t]]. 
The first order deformations ai are parametrized by second Hochschild co- 
homology HH^ {A) of A. Inserting (Q) into the Maurer-Cartan equation, we 
get ^ 

dman = -^ ^ [ak.oii] (2) 

k+l=n 

for all n. Since n > 1, we get fc, Z < n — 1 on the right hand side and we can 
use (0) to solve the Maurer-Cartan equation perturbatively (in principle; the 
actual construction of the solution turns out to be a highly involved problem, 
see |Kon 199?] for a solution in the special case where A is the algebra of 
smooth functions on a manifold). 
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Now, let M be a complex algebraic variety and suppose that M is a 
Calabi-Yau variety. Consider the Hochschild complex of the holomorphic 
structure sheaf Om of M. This has a similar structure as the Hochschild 
complex of an associative algebra. The Hochschild cohomology HH"' {OM)oi 
Om decomposes as 



where denotes usual sheaf cohomology and Tm is the holomorphic tangent 
bundle of M. So, the Hochschild cohomology of Om is given as the cohomol- 
ogy of the exterior powers of the tangent bundle. The first order deforma- 
tions of the pointwise product structure of Om are given by the component 
HH^ (Om)- This includes, especially, the component with p = q = 1 which 
parametrizes the first order Kodaira-Spencer deformations of the complex 
structure of M. The finite (i.e. noninfinitesimal) Kodaira-Spencer deforma- 
tions are given by the solutions of the Kodaira-Spencer equation 



where, in accordance with Q, 7 is a (0, l)-form valued vector field and 
[, ] denotes the commutator of vector fields and wedging. Observe that the 
Kodaira-Spencer equation is formally a Maurer-Cartan equation, again. In 
^BCOV] it was shown that the Kodaira-Spencer equation can be derived from 
an action principle and that the tree level expansion of the resulting field the- 
ory {Kodaira-Spencer theory of gravity) precisely solves the Kodaira-Spencer 
equation in a treatment completely analogous to ((21). The BV-quantization 
of the theory then shows that one has to include nonclassical ghost numbers 
which mathematically results in passing from the Kodaira-Spencer deforma- 
tions to the total Hochschild complex of Om with the cohomology given by 
(0) (in physics terminology passing from the purely marginal deformations 
given by Kodaira-Spencer theory to the extended moduli space of |Wit 1991] , 
see jKon 199^ for a mathematical approach to this space). The distinction 
between the complex and the cohomology on the mathematical side corre- 
sponds to the distinction between off-shell and on-shell states in physics (see 
e.g. |HMj for a detailed exposition of this point). The Maurer-Cartan equa- 
tion on the Hochschild complex corresponds to the Master-equation of BV- 
quantization, the Gerstenhaber bracket corresponds to the BV-antibracket, 




(3) 



•97+2 b'^] = 
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and the BV-action functional reduces to the classical action if one considers 
only classical fields because the Maurer-Cartan equation on (jS)) reduces to 
the Kodaira-Spencer equation if one considers only Kodaira-Spencer defor- 
mations. So, the essential requirements of BV-quantization (Master-equation 
and the correct reduction to the classical action on classical fields) are ful- 
filled just by the fact that the Kodaira-Spencer deformation can be embedded 
into the larger deformation theory on the Hochschild complex of Om (with 
Maurer-Cartan type equations being preserved). 

We show below that the coupled system of differential equations which we 
derive for the general deformation problem of quantum vertex algebras can 
likewise be derived from an action principle. This action can be understood 
as generalizing the action of the Kodaira-Spencer theory of gravity. We 
formulate a list of goals which would be interesting to reach in a perturbative 
(tree level, as well, as loop expansion) treatment of the resulting field theory. 
At present the perturbative study of the theory is limited by the fact that one 
would first have to find a suitable gauge fixing for the action (corresponding 
to the Tian gauge in the Kodaira-Spencer theory of gravity). 

The paper is structured as follows: In section 2, we consider the defor- 
mation problem for the outer category (C, w,®), i.e. • and ® receive de- 
formations. In section 3, we include the inner bialgebra object B into the 
consideration. We will see that one needs an additional assumption - which 
basically says that a reconstruction theorem between B and its category of 
representations in C is supposed to hold - in order to be able to treat this 
case as an algebraic deformation problem. Under this assumption, the de- 
formation problem can be reformulated as that for two monoidal categories 
{M., •, ®) and (C, •, 0) with a monoidal forgetful functor 

where both compositions • and both tensor products ® and the monoidal 
functor become deformed. Here, and in the sequel, we will use the same 
symbol for the compositions in Ai and C (and likewise for the tensor prod- 
ucts) if no confusion is possible. In section 4, we formulate the list of goals 
mentioned above. Section 5 contains some concluding remarks. 

A disclaimer: We certainly do not claim that the structures which we 
study in this paper constitute a notion of quantum vertex algebras. Much 
more structure is needed for this. For part of this structure, one would expect 
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the existence of theorems saying that the deformation of these structural 
components canonically goes along with the deformations considered, here 
(much the same way as e.g. the counit in a Hopf algebra canonically goes 
along with the deformations of the product and coproduct). But the proof 
of such theorems is a nontrivial matter which needs further investigation. 
When we speak of the deformation problem of quantum vertex algebras in 
our context, we only want to point to the following fact: Vertex algebras can 
be considered as singular commutative rings in certain monoidal categories. 
In this sense, the deformation problem which we consider is the most general 
deformation problem for those part of structure which are the essential ones 
for the deformation of vertex algebras. Given the highly nontrivial nature 
of the question of deformations of quantum vertex algebras, we believe that 
such a boiled down approach is justified. 



2 Deformation of the monoidal category 

Let 

A := Morph (C) 

denote the class of morphisms of C. Let Kl denote the tensor product of C- 
linear tensor categories as used e.g. in |CFj . i.e. we can understand a bilinear 
functor on C as a linear functor from C Kl C to C. We also denote by Kl the 
corresponding tensor product on A. Then let TA denote the categorical 
tensor algebra of multilinear maps on A, i.e. 

TA = {$ : KM ^ A linear} 

where the definition of the categorical direct sum is obvious. 

In deforming the composition • to • we will assume that the domain 
and codomain maps on C remain undeformed, i.e. a • 6 is defined iff dib is 
defined. For the deformation of C?) to 0, we make the following assumption: 
We assume that this deformation does not change the tensor product of 
objects on a C-linear level, i.e the object maps of (8> and (S> should agree 
after applying the monoidal forgetful functors to the category V of (finite 
and infinite dimensional) vector spaces to both (remember that we suppose 
such forgetful functors always to exist, see the introduction). Especially, 
this means that after applying forgetful functors the domains and codomains 
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of a ® 6 and a®b agree. In addition, we assume that we can fully study 
the deformation problem for (g) by studying the deformation problem for the 
morphism map of 0. 
We write 

• = • + / 

and 

® = ® + ^ 

where / and g are linear 

f,g : AMA^ A 

and addition + can be understood as componentwise addition on the Home (; )- 
sets after applying the forgetful functor to V. 

We start with the consideration of the deformation problem for •. The 
requirement is that • should be associative, again. For a, b,c in A and com- 
posable in the required order, this leads to 

^a«6 j ic = di {b'ic) 

and therefore to 

[•J] + l[fJ] = [*J] + fof = 

where o and [, ] on TA are defined in complete analogy to the case of the 
Hochschild complex of an associative algebra (see the introduction). Observe, 
here, that / (a, b) is defined iff a • 6 is defined and that • is linear, 

• -.A^A^A 

For $ in TA define d, by 

We have (c?,)^ = and d, defines a differential on TA. Then associativity of 
• can be formulated as 

d.f + fof = Q (4) 

which is a Maurer-Cartan type equation. 

Let us now pass to the deformation problem for ®. We assume that all the 
monoidal categories which we consider are strict monoidal. This is possible 
by a coherence theorem of Mac Lane (see |Macj ). Besides making calculations 
simpler, this assumption might also be justified on a deeper level: By the 
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very existence of the coherence theorem, one expects that when deriving the 
deformation problem from a field theory action principle, the more general 
case of a nontrivial associator should automatically arise by including BRST- 
exact terms. Then the restriction imposed upon the deformation problem is, 
again, associativity of (g), leading to 

d®g + gog = Q (5) 

where is defined by 

for $ in TA. Observe that by the restriction to the consideration of the 
morphism map of ®, we can, again, view (g) as linear, 

: A^A^ A 

What remains to be considered is the compatibility constraint on • and <S> in 
order that they define together a monoidal category, again. For ai, 02, 03, 04 
in A such that 

(oi (g) 02) • (as (g) 04) 

exists this means that 

(01(8)02) • (03(8)04) = (Oi«03) (8) (02«04) 

i.e. 

(• + /) ((® + 9) (oi, 02) ,{^ + 9) (as, 04)) 
= {^ + 9) ((• + /) (ai, as) ,(• + /) (02, 04)) 

which by using compatibility of • and (8) is equivalent to 

9 (oi, 02) • (as <8) 04) + (oi (8) 02) • (03, 04) (6) 
+5r (01,02) •5' (03,04) 

+/ (oi (8) 02, 03 (8) 04) + / (oi (8) 02, c/ (03, 04)) 
+/ {g (oi, 02) , os (g) 04) + / {g (oi, 02) , 5- (03, 04)) 
-/ (ai, as) ® (^2 • 04) - (ai • as) <8) / (02, 04) 
-/ (01,03) (8) 7(02,04) 
-5' (oi • 03, 02 • 04) - (oi • 03, / (02, 04)) 

-g if (oi, os) , 02 • 04) - (/ (oi, 03) , / (02, 04)) 

= 
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We will now discuss the structural properties of the terms in (jH)). Observe 
that (jni) contains terms of first, second, and third order in the fields f,g 
(especially, this means that these terms appear, upon expanding / and g 
according to (0), for the first time in the respective order in the resulting 
expansion of ©)• We start with considering the first order terms: There are 
six first order terms, three in each of the fields / and g. Taking only the 
three first order terms in g, we have 

(ai ® a2) • g (cis, ^4) - 5' (ai • as, ^2 • a-i) + g (ai, 0-2) • {as ® 0-4) (7) 

Remember that g is linear. 



But - as a consequence of our assumption that domain and co domain maps 
are preserved in the deformation - we can locally on the Hom-sets replace 
Kl by (g) after applying the forgetful functor to V (alternatively, we can view 
this as evaluating an expression a lEI 6 to ^ (a^b) = a ® b). We can then 
simply rewrite (|7j) to 

(ai ® • g (03 ® a^) - g ((ai • a^) ® (02 • 04)) + g{ai® 02) • (03 ® a^) 
= (ai ® • g (03 ® a^) - g ((ai ® 02) • {a^ ® a^)) + g{ai® 02) • (03 ® a^) 

where we now interpret g a,s a, function of one variable on the tensor product. 
Defining 

df^^f (01,02,03, 04) 

= (oi (g) • g (03 ® tti) - g ((oi (g) 02) • (0.3 ® «4)) + fi' (oi ® 02) • (03 ® 04) 

and similarly for a general n- variable function $ on the tensor product, we see 
that df is just the Hochschild differential d, with respect to •, as introduced 
above, hfted to the twofold tensor product (hence the notation df ). It 
therefore immediately follows that 



g : A^A^ A 




Hence, the three terms in (0) can be written as 



df g (01,02,03,04) 
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The three first order terms in / are 

- (ai • as) (g) / (a2, 04) + / (ai ® a2, as ® a^) - f (ai, as) ® (^2 • a4) (8) 

By interchanging the roles of • and ®, we can - in complete analogy to the 
preceding argument - rewrite (jH))- This time, we imagine a IE 6 as being 
evaluated to • (a Kl 6) = a • 6 in order to interpret / as a function of a single 
variable. With 

d% f ('^1; '^25 flS; 0,4) 

= (ai • as) / (a2 • a^) - f ((ai (g) a2) • (as (g) a4)) + / (ai • as) (8 (a2 • a4) 
= (ai • as) ® / (a2 • a4) - / ((ai • ag) O (a2 • a4)) + / (ai • ag) (g) (a2 • a4) 

we can rewrite the three first order terms in / as 

—d'^ f (ai, a2, as, a4) 

Observe that we keep the upper index (g^ for the differential lifted to the 
two fold tensor product since this is what occurs for the linear spaces before 
evaluating with •. (i| is the Hochschild differential from above, lifted to 
the two fold tensor product. Especially, we have 




Let us next turn to the consideration of the second order terms. There are, 
again, six terms: There is one term each which is quadratic in /, respectively 
g, and four terms which contain / and g. From the mixed terms, two have g 
left of / and two vice versa. Let us start with the consideration of the latter 
ones: These are 

/ {g (fli, 0,2) , as (g a4) + / (ai (g a2, g (as, a4)) 

Rewriting this, again as 

/ {g (ai (g a2) , as (g a4) + / (ai (g a2, g (as (g a4)) 

we can view g as a. function of one variable and / as a function of two variables 
on the twofold tensorproduct. Using the composition o on TA, we can write 
this as 

(/ 9) (ai,a2,as,a4) 
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where the notation o^- which should in a more detailed form be written as 
- indicates the lift to the twofold tensorproduct, again. Similarly, we can 
rewrite the other two mixed terms as 

- {9 °^ /) (01,02,03,04) 
So, the second order terms can altogether be written as 

{{f 9) - {9 f) + 9 • 9 - f f) (01,02,03,04) 

Remark 1 Here and in the sequel, we neglect any switch functions for the 
arguments as they appear in terms like f ® f where the arguments appear 
in the order ai,a^^a2,ai instead of ai,a2,a3,a4^. These switches are obvious 
from the requirement that composability in the undeformed category C has to 
be satisfied (and consequently also holds then in the deformed setting) for all 
the expressions appearing. 

Finally, we turn to the consideration of the third order terms. In usual 
Hochschild cohomology, one only has a differential (function of one variable) 
and a bracket (function of two variables) on the complex. Here, we encounter 
a new function of three variables which we introduce for 

$1,<I>2,$3 i^""' 

as 

Camp ($1, $2, $3) (oi, 02, 03, 04) = $1 ($2 (oi, 02) , $3 (03, 04)) 

For general $1, $2, $3 of degrees ni, n2, n3, respectively. Camp generahzes to 
an alternating sum of $2 and $3 inserted into $1 with different positions in 
the arguments of $1, again. Using this three variable function Camp, we can 
rewrite (jH)) as 

= dff-dfg + f0f-g.g-{fo^g) + {go^f) (9) 
-Camp (/, g, g) + Camp {g, /, /) 

So, the deformation problem of a monoidal category leads to the coupled 
system of differential equations (jD), (0), and Q as replacing the Maurer- 
Cartan equation on the usual Hochschild complex. 
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Remark 2 By linearity in the three arguments, the third order terms in- 
volving Camp are similar to the appearance of curvature terms. The only 
difference is that the curvature tensor is antisymmetric with respect to the 
last two indices while the two terms Camp (/, g, g) and Camp {g, f, f) appear- 
ing are symmetric in the last two variables. Can one understand the third 
order terms as true curvature contribution by taking into account the grading 
on the deformation complex (i.e. a kind of super- curvature)? If yes, does 
this imply that one no longer has a fiat connection as in fPu^ on the moduli 
space of deformations? This would be similar to the situation one has for the 
appearance of superpotentials in string theory. 

Let us assume the existence of a trace on TA which we will write as J . 
Then we claim that one can formally derive this coupled system of differential 
equations from the action 

[2 2 
S ~ {f°d,f+-fofof + god^g+-gogog (10) 

+Ao2 [dff-dfg + f®f-g.g-{fo^g) + {go' f) 
-Camp (/, g, g) + Camp {g, f, /)]} 

with fields f,g, X. Here, the field 

A : A(g)A^ A 

enters as a Lagrange multiplier into (|TIHl in order to install the constraint 
Q. 

Remark 3 For a bundle of quantum vertex algebras on a manifold M, we 
can view the integral J as including the integration over M besides the trace. 

Observe that variation of S with respect to / leads in TA to an expression 
in degree three resulting from the first two terms and to an expression in 
degree four for the rest. Therefore these two expressions have to vanish 
separately and we get associativity of • + / from the first two terms of S. 
Similarly, we get associativity of ® + (7. The action (fTUI) describes a system 
of two Chern-Simons like theories, coupled by the constraint Q. 
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3 Inclusion of the inner bialgebra object 



We now want to generalize ()10|) to include the deformation of the inner 
bialgebra B object, too. Suppose, first, that B is only an inner algebra object 
of C with associative product -k. Deforming ^ to ^ gives another Maurer- 
Cartan type equation from the requirement that ^ should be associative, 
again. The compatibility constraint with the deformation of C is that ★ 



should be a morphism in the deformed monoidal category ( C, •, ® ) . But the 



condition of being a morphism in C is not a purely algebraic condition but one 
of the type saying that ? should behave well under all possible compositions 
with morphisms of C. We therefore proceed in a slightly different way which 
we are now going to explain. It turns out to be useful to consider B as a. 
bialgebra object in C, now, from the beginning. 

Let Repc (B) be the category of representations of B on objects of C. 
Since i? is a bialgebra object in C and therefore carries a coproduct, Repc (B) 
is a monoidal category. We will now make an additional assumption: In the 
theory of usual Hopf algebras, there exist a number of so called reconstruction 
theorems which state that under certain conditions a Hopf algebra and its 
category of representations determine each other up to isomorphism (see e.g. 
|CPj ). We will assume that in the same way the inner bialgebra object B can 
be reconstructed from its category Repc [B) of representations in C. With 
this assumption, the deformation problem of the inner bialgebra object B 
turns into the deformation problem for the monoidal category 



where deformations of the product on B correspond to deformations of the 
composition • in A4 while deformations of the coproduct of B correspond to 
deformations of the tensor product ^ of Ai. Here and in the sequel we use 
the same symbols for composition • and tensor product (8> of C and Ai if no 
confusion is possible. Hence, we double the deformation structure studied in 
the previous sections by studying the deformations of two monoidal categories 
C and Ai. As the compatibility constraint - replacing the constraint that ? 
should be a morphism of C - we use the requirement that the monoidal 
forgetful functor 




M = Repc (5) 



C 



should be deformed to a monoidal functor 



C 
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With 

• = • + / 

and 

® = ® + ^ 

for the deformation of C as above and similarly 

• = • + (p 

and 

® = ® + ^l) 

for the deformation of M., plus 

^ = J' + fi 

for the deformation of JF, we have altogether five fields /, y?, if), VL. Here, Vl 
is viewed as a linear map between the morphism classes of M. and C since 
the object classes remain undeformed after applying forgetful functors to V 
(linearity of Vl means, of course the local linearity on the Hom-sets). We 
will now study the constraints arising for Q. Since has to be a monoidal 
functor, again, we have 

^ (aib) = ^ (a)*^ (b) (11) 

and _ _ _ 

T (a^b) = (a) (b) (12) 

for the morphisms of Ai. Let us study ()11|) in detail. (fTTj) implies 

= J^{^{a,b)) + n{a»b)-J^{a)»n{b) (13) 
-^](a).^(6)-/(^(a),^(6)) 

((^ (a, 6)) - (a) • (6) - / (^ (a) , n (6)) - / (fi (a) , ^ (6)) 
-/(fi (a), nib)) 

Remember that, here, JF is not a field but the constant undeformed monoidal 
forgetful functor from Ai to C. (jl3j) contains five terms of first order in the 
fields, four terms of second order, and one term of third order. We start by 
considering the three first order terms in Q. These are 

T{a)»n{b)-n{a»b) + n (a) • T (b) 
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Defining 

rff<l> (ai, ...,a„+i) = J'(ai) • $ (a2, - $ (ai • 02,03, ...,a„+i) 

±... ± $ (ai, a„_i, an • a„+i) ± $ (ai, a„) • (ctn+i) 

we have 

d^Vt (a, 6) = (a) • (6) - (a • 6) + (a) • (b) 

One proves by calculation - using the functoriality of JF - that 

We call d-^ the twist of the differential d,. 

We write ^ (y?) (a, 6) for JF (yj (a, 6)) since we just apply after y?, here. 

Similarly, we write / ^JF®^ j (a, 6) for / (JF (a) , JF (6)), indicating in the nota- 
tion that J-" is first applied in both components. Then the first order terms 
of (fT3|l can be summarized to 

(14) 

Let us next consider the two second order terms in / and Q. We have 

/(^](a),^(6)) + /(^(a),^](6)) 

Compare this with the composition of / of degree two and Q of degree one 
to 

(fan) (a,6)=/(^](a),6) + /(a,fi(6)) 

In complete analogy to the jF-twisted differential d^, we can introduce the 
jF-twisted composition o-^and get 

(/ n) (a, b)=fin (a) , ^ (6)) + / (a) , (6)) 

Remark 4 Observe that the positions in which T appears in the J^-twisted 
forms are determined by the requirement that the needed compositions are 
well defined. 
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Introducing Q {(f) in complete analogy to the notation for the first order 
terms, we can summarize the four second order terms of (|13|) to 



n{ip) f o-^ n (is) 

Using, again, the notation introduced for the first order terms, we can rewrite 
the single third order term as / (Q^^). Together with ()14j) and (fTH|) . this 



leads to an equivalent reformulation of (|13|) as 

= + _jr(y,) + /o^fi (16) 

In a completely analogous way, we can treat the constraint (fT^ . leading to 
= d^n + g(^J^^'^-J^i^)+go^n (17) 

In summary, for the complete deformation problem of the two monoidal 
categories C and Ad together with the monoidal functor 

we get a doubled set of the three coupled differential equations of the previous 
section plus the two constraints (fT^ and (fT7|) . So, in total, we get a coupled 
system of eight differential equations which replace for the general deforma- 
tion problem of quantum vertex algebras the Maurer-Cartan equation of the 
usual Hochschild complex. 

We claim that one can formally derive the complete system of eight cou- 
pled differential equations by variation from the action 

[2 2 

S ~ {f °d,f + -f o f o f + g od(^g + -g o go g (18) 

2 2 

+(p o d,(p +-(poif>oif + iljo d^lp + -lp o ijj o ifj 
o o 

+\^ o2 ld%'f-dfg + f0f-g.g-{fo^g) + {go^ f) 
-Comp (/, g, g) + Comp {g, /, /)] 

+A2 o2 - dfi; + (fi (fi - ip • ip - {if o'^ tp) + [ip o'^ if) 

17 



—Camp {(f, ip, i') + Camp ip, ip)] 

+A3 o [d^n + f (^«') -jr^^) + fo^n 
+A4 o [d^n + g _ ^ (^) + ^ 

with fields /, g, (p, ip, Q, Ai, A2, A3, A4. Here, the fields Ai, A2, A3, A4 appear as 
Lagrange multipliers for the constraints where Ai,A2 are of the same type 
as f, g,ip,ilj, i.e. they are linear two variable maps on the morphisms of C 
and Ai, respectively, while A3, A4 are of the same type as fl, i.e. one variable 
linear maps from the morphisms of Ai to the morphisms of C. 
The action (fTH|) includes interesting special cases: The case 

f = g = ^P = 

corresponds in the setting of |Borj to the case where the outer category C 
remains fixed and only the inner ring object R is deformed. This should 
correspond to a deformation theory for the field algebras of |BKj. Imposing 
an additional commutativity constraint on the inner ring object R should 
lead to deformations of usual vertex algebras (see |Tamj for a study in the 
setting of the chiral algebras of |BDp and - in the infinitesimal case - to the 
vertex algebra cohomology of |KVj . It remains a task for future work to 
rigorously check the embedding of these cases into our framework. 

Since we treated the deformation problem in an abstract setting, one 
is not restricted to apply it to the deformations of quantum vertex alge- 
bras. Another special case which is covered by (jl8j) is the deformation prob- 
lem for three dimensional topological quantum field theories (3d TQFTs for 
short). A 3d TQFT is a monoidal functor {Atiyah functor) from the cate- 
gory Cobord of three dimensional cobordisms with disjoint union as tensor 
product to the category Vect of finite dimensional vector spaces with the 
usual tensor product. The deformation problem for Atiyah functors is then 
the deformation problem for this monoidal functor with Cobord and Vect 
fixed, i.e it is included into the deformation theory given by (|18|) by making 
the special choice Ai = Cobord and C = Vect and 

f = g = (p = ^ = 
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The action (|18p generalizes the action of the Kodaira-Spencer theory of 
gravity of |BCUVj in the following sense: The BV-quantization of Kodaira- 
Spencer theory leads to the deformations described by the total Hochschild 
complex of the structure sheaf on a complex three dimensional Calabi-Yau 
manifold. Physically, this can be seen as the deformation theory of the 
BRST-complex of the topological open string. For the topological closed 
string a much more complicated deformation theory of the BRST-complex 
arises (see |HMj ) where the Aoo-deformations - leading to a Hochschild de- 
formation complex as for the open string case - constitute only a special case 
which is very similar to the special case of quantum vertex algebra defor- 
mations where only the inner ring object R is deformed. It is not clear at 
present if the action (fTH|) leads to the deformations described in jHMj but it 
is interesting in any case that the deformation problem for quantum vertex 
algebras suggests a generalization of the action of Kodaira-Spencer theory. 



4 A list of goals 

We now give a list of goals one would like to reach in future work by studying 
the action ()18p in more detail. 

• Find a gauge fixing for (jl8|) similar to the Tian gauge for the Kodaira- 
Spencer theory of gravity. Such a gauge fixing is the prerequisite for 
making use of (fTHj) in the study of the deformation problem of quantum 
vertex algebras. 

• Study the tree level expansion of (fTHj) . Can one derive a formality 
property for the deformation problem of quantum vertex algebras in 
this way as it is possible for Kodaira-Spencer theory on Calabi-Yau 
varieties or for the Hochschild complex in the case of |Kon 199?] ? 

• Study the loop corrections for (fTBj) . Is there an analog of the holo- 
morphic anomaly of Kodaira-Spencer theory? If yes, to what kind 
of structures does the extended moduli space - including non-classical 
ghost numbers - lead? 

• In |Kon 1999j and |KSj it was conjectured that a quotient of the motivic 
Galois group which should be given by the Grothendieck-Teichmiiller 
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group GT, as introduced in |Drij . acts as a symmetry on the extended 
moduli space of Kodaira-Spencer theory. The algebraic nature of the 
compatibility constraint appearing between deformations of • and ® 
suggests that for the deformation theory of quantum vertex algebras the 
situation is very similar to the one studied in |Schj . We therefore expect 
that the quantum analogue of GT, introduced in |Schj in the form of a 
self-dual, noncommutative and noncocommutative Hopf algebra Ti-oT, 
should appear as a symmetry on the moduli space related to (fTHj) . Can 
one verify this by studying the field theory given by (fTHjl ? 

• In jSchj we have given an argument that deformations on higher cat- 
egorical analogs of the structures studied there have to be trivial. We 
expect that in a completely similar way the deformation problem of 
quantum vertex algebras can not be generalized in a nontrivial way to 
a similar deformation problem in the setting of monoidal 2-categories 
or higher monoidal n-categories. This should imply an unusual stabil- 
ity property for the field theory given by ()18|) against further defor- 
mations. We have seen that Maurer-Cartan type equations and their 
generalizations studied in this paper are strongly related to a perturba- 
tive treatment of the deformation problem (in the sense of deformations 
given by formal power series). Would such a stability property mean 
that the field theory given by (fTHj) can be completely understood from 
a perturbative treatment? Does it mean that (fTHj) is free of anomalies 
at any loop order and that the extended moduli space of (fTHj) involves 
a more or less trivial extension? 

• Study (fTHj) in a concrete example. E.g., study the deformation problem 
for the chiral de Rham complex on the affine space (as introduced in 
|MSVj ). i.e. the deformation problem for the tensor product of the 
Heisenberg and the Clifford vertex algebra. This should be of interest 
for studying the deformations of the models appearing in jWit 2005] . 



5 Conclusion 

We have studied the deformation problem of quantum vertex algebras in an 
abstract - or better boiled down - setting. We have derived a coupled system 
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of eight differential equations generalizing the Maurer-Cartan equation of 
the usual Hochschild complex. We have shown that this system of equations 
can formally be derived from an action principle which in a certain sense 
generalizes the action of Kodaira-Spencer theory. 

One of the next steps in our work will be the study of ()18|) in a highly sim- 
plified example. For this, we will study the deformation problem for the case 
of topological minimal models where it does reduce to a deformation problem 
in usual Hochschild cohomology which can be formulated as a deformation 
problem for a prepotential on a noncommutative moduli space. 

Acknowledgments: We would like to thank B. Bakalov, E. Frenkel, M. 
Kreuzer, and F. Malikov for discussions on or related to the material of this 
paper. 
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